Random Projections For Large-Scale Regression

Fitting linear regression models can be computationally very expensive in large-scale data analysis tasks if the sample size and the number of variables are very large. Random projections are extensively used as a dimension reduction tool in machine learning and statistics. We discuss the applications of random projections in linear regression problems, developed to decrease computational costs, and give an overview of the theoretical guarantees of the generalization error. It can be shown that the combination of random projections with least squares regression leads to similar recovery as ridge regression and principal component regression. We also discuss possible improvements when averaging over multiple random projections, an approach that lends itself easily to parallel implementation.Comment: 13 pages, 3 Figure

Subtypes of narcissistic personality disorder based on psychotherapy process: A longitudinal nonparametric analysis.

The present study aims at empirically exploring subtypes of narcissistic personality disorder (NPD), based on patient descriptors of the psychotherapeutic process. Subtype identification and characterization of NPD is central, in particular, to increase diagnostic precision, linking categorical and dimensional conceptualizations of psychopathology, and to individualize treatments. A total of N = 161 patients diagnosed with NPD undergoing clarification-oriented psychotherapy were included in the present reanalysis of a naturalistic pre-post process-outcome study. At three crucial time-points of the therapy (Sessions 15, 20, and 25), the patient's in-session quality of content, process, and relationship are assessed using intensive video- and audio analyses. Levels of psychopathology were assessed using self-reported questionnaires. Data were analyzed using longitudinal nonparametric analysis. Based on in-session processes across three time-points, a two-subtype solution was retained (optimal vs. suboptimal process qualities). Optimal process quality of time was linked with the intensity of narcissistic symptoms; suboptimal process quality was linked with a variety of general symptom loads and problematic personality traits. The two empirical subtypes were predicted by the quality of real-life functioning with an accuracy of more than 92% and were partially associated with outcome. NPD may be empirically differentiated between patients engaging in optimal psychotherapy process versus those who engage in suboptimal psychotherapy process. This differentiation has reliable clinical predictors at the outset of treatment. The present study has implications in terms of personalizing psychotherapy for patients presenting NPD, or pathological narcissism. (PsycInfo Database Record (c) 2021 APA, all rights reserved)

Near-forward Raman scattering by bulk and surface phonon-polaritons in the model percolation-type ZnBeSe alloy

We study the bulk and surface phonon-polaritons of the Zn0.67Be0.33Se zincblende alloy by near-forward Raman scattering. The short (Be-Se) bond exhibits a distinct percolation doublet in the conventional backscattering Raman spectra, corresponding to a three-mode behavior in total [1(Zn-Se),2(Be-Se)] for Zn0.67Be0.33Se. This offers an opportunity to achieve a refined understanding of the phonon-polariton modes of a zincblende alloy beyond the current two-mode approximation, corresponding to a [1(Zn-Se),1(Be-Se)] description in the present case. The discussion is supported by contour modeling of the Raman signals of the multi-mode bulk and surface phonon-polaritons within the formalism of the linear dielectric response

Understanding the risk of emerging bacterial resistance to over the counter antibiotics in topical sore throat medicines

Aims The aims of this study were to explore the development of bacterial resistance and cross‐resistance in four common human pathogens following realistic exposure to antibiotics found in over‐the‐counter (OTC) sore throat medicines: gramicidin, neomycin, bacitracin and tyrothricin. Methods and Results Bacterial exposure to in‐use (concentration in the product before use) and diluted concentration (i.e. during use ) of antibiotic where conducted in broth for 24 h or until growth was visible. The changes in bacterial susceptibility profile before and after exposure was determined using standardized ISO microdilution broth. Antibiotic testing was performed according to EUCAST guidelines. We demonstrated that test bacteria were able to survive exposure to the in‐use concentrations of some antibiotics used in OTC medicines. Exposure to during use concentrations of bacitracin resulted in stable increase in minimal inhibitory concentration (MIC) (>8‐fold) in Staphylococcus aureus and Acinetobacter baumannii . Exposure to tyrothricin resulted in a stable increase in MIC (2·4‐fold) in Klebsiella pneumoniae , and exposure to neomycin resulted in a stable increase MIC (5000‐fold higher than the baseline) in Streptococcus pyogenes . Clinical cross‐resistance to other antibiotics (ciprofloxacin, fusidic acid, gentamicin, cefpodoxime, amoxicillin/clavulanic acid and cefotaxime) was also demonstrated following exposure to bacitracin or tyrothricin. Bacitracin exposure lead to a stable bacterial resistance after 10 passages. Conclusions Our results indicate that OTC antibiotic medicines have the potential to drive resistance and cross‐resistance in vitro . Significance and Impact of the Study Tackling antibiotic resistance is a high worldwide priority. It is widely accepted that the overuse and misuse of antibiotics increase the risk of the development and spread of antibiotic resistance within communities. A number of OTC sore throat products, widely available across the world for topical use in respiratory indications, contain locally delivered antibiotics. Our findings showed that these antibiotics in OTC medicines present a risk for emerging cross‐resistance in a number of bacterial respiratory pathogens

Private Incremental Regression

Data is continuously generated by modern data sources, and a recent challenge in machine learning has been to develop techniques that perform well in an incremental (streaming) setting. In this paper, we investigate the problem of private machine learning, where as common in practice, the data is not given at once, but rather arrives incrementally over time. We introduce the problems of private incremental ERM and private incremental regression where the general goal is to always maintain a good empirical risk minimizer for the history observed under differential privacy. Our first contribution is a generic transformation of private batch ERM mechanisms into private incremental ERM mechanisms, based on a simple idea of invoking the private batch ERM procedure at some regular time intervals. We take this construction as a baseline for comparison. We then provide two mechanisms for the private incremental regression problem. Our first mechanism is based on privately constructing a noisy incremental gradient function, which is then used in a modified projected gradient procedure at every timestep. This mechanism has an excess empirical risk of $\approx\sqrt{d}$, where $d$ is the dimensionality of the data. While from the results of [Bassily et al. 2014] this bound is tight in the worst-case, we show that certain geometric properties of the input and constraint set can be used to derive significantly better results for certain interesting regression problems.Comment: To appear in PODS 201

Extreme State Aggregation Beyond MDPs

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp.\ MDP) assumptions on the environment. State aggregation and more generally feature reinforcement learning is concerned with mapping histories/raw-states to reduced/aggregated states. The idea behind both is that the resulting reduced process (approximately) forms a small stationary finite-state MDP, which can then be efficiently solved or learnt. We considerably generalize existing aggregation results by showing that even if the reduced process is not an MDP, the (q-)value functions and (optimal) policies of an associated MDP with same state-space size solve the original problem, as long as the solution can approximately be represented as a function of the reduced states. This implies an upper bound on the required state space size that holds uniformly for all RL problems. It may also explain why RL algorithms designed for MDPs sometimes perform well beyond MDPs.Comment: 28 LaTeX pages. 8 Theorem

Near-forward Raman selection rules of the phonon-polariton created by alloying in (Zn,Be)Se

The Raman selection rules of the (ZnSe, BeSe) mixed phonon polariton created by alloying in the three mode (1ZnSe, 2BeSe) ZnBeSe system, whose dramatic S like dispersion covers the large frequency gap between the ZnSe and BeSe spectral ranges, is studied in its wave vector dependence by near forward scattering. Both the collapse regime away from the Brillouin zone centre and the reinforcement regime near the Brillouin zone centre are addressed, using appropriate laser lines and Be contents. We find that in both regimes the considered phonon polariton, in fact a transverse mode with mixed mechanical and electrical character, obeys the same nominal Raman selection rules as its purely mechanical variant commonly observed in the backscattering geometry. Besides, marked differences in the phonon polariton Raman lineshapes in the two regimes give a hint about how the phonon polariton electrical field E develops while descending the S like dispersion towards the Brillouin zone centre. In the reinforcement regime E is large, leading to intramode on top of intermode transfers of oscillator strength mediated by E between the two BeSe modes, that both exhibit a fine structure on account of the alloy disorder. In contrast, in the collapse regime E remains weak, as testified by the absence of intramode transfer. The discussion is supported by contour modeling of the multi phonon polariton Raman lineshapes in their wave vector dependence within the linear dielectric approach.Comment: 16 pages, 7 figure

Furosemide stimulation of parathormone in humans: role of the calcium-sensing receptor and the renin-angiotensin system.

Interactions between sodium and calcium regulating systems are poorly characterized but clinically important. Parathyroid hormone (PTH) levels are increased shortly after furosemide treatment by an unknown mechanism, and this effect is blunted by the previous administration of a calcimimetic in animal studies. Here, we explored further the possible underlying mechanisms of this observation in a randomized crossover placebo-controlled study performed in 18 human males. Volunteers took either cinacalcet (60 mg) or placebo and received a 20 mg furosemide injection 3 h later. Plasma samples were collected at 15-min intervals and analyzed for intact PTH, calcium, sodium, potassium, magnesium, phosphate, plasma renin activity (PRA), and aldosterone up to 6 h after furosemide injection. Urinary electrolyte excretion was also monitored. Subjects under placebo presented a sharp increase in PTH levels after furosemide injection. In the presence of cinacalcet, PTH levels were suppressed and marginal increase of PTH was observed. No significant changes in electrolytes and urinary excretion were identified that could explain the furosemide-induced increase in PTH levels. PRA and aldosterone were stimulated by furosemide injection but were not affected by previous cinacalcet ingestion. Expression of NKCC1, but not NKCC2, was found in parathyroid tissue. In conclusion, our results indicate that furosemide acutely stimulates PTH secretion in the absence of any detectable electrolyte changes in healthy adults. A possible direct effect of furosemide on parathyroid gland needs further studies

Blood Pressure and Renal Responses to Orthostatic Stress Before and After Radiofrequency Renal Denervation in Patients with Resistant Hypertension.

In patients with resistant hypertension, renal denervation (RDN) studies have mainly focused their outcomes on blood pressure (BP). The aim of this study was to evaluate the long-term effect of RDN on neurohormonal profiles, renal hemodynamics and sodium excretion in a resting state and during stress induced by lower body negative pressure (LBNP). This was a single center prospective observational study. Norepinephrine, plasma renin activity (PRA), glomerular filtration rate (GFR), renal plasma flow (RPF) and sodium excretion were measured in unstimulated conditions (rest) and after one hour of LBNP at three different time points: before (M0), one (M1) and twelve months (M12) after RDN. Thirteen patients with resistant hypertension were included. In the resting state, no differences were observed in norepinephrine, PRA, sodium excretion and mean BP levels after RDN. GFR (78 ± 32 ml/min at M0 vs 66 ± 26 ml/min at M12 ( <i>p</i> = 0.012) and filtration fraction (22.6 ±5.4% at M0 vs 15.1 ±5.3% at M12 ( <i>p</i> = 0.002)) both decreased after RDN. During LBNP, the magnitude of the mean BP increase was reduced from +6.8 ± 6.6 mm Hg at M0 to +2.3 ± 1.3 mm Hg at M12 ( <i>p</i> = 0.005). The LBNP-induced increase in norepinephrine and decrease in GFR and sodium excretion observed before RDN were blunted after the procedure. A decrease in GFR and filtration fraction was observed one year after RDN. In addition, our results suggest that RDN blunts not only the norepinephrine but also the mean BP, the GFR and the sodium excretion responses to an orthostatic stress one year after the intervention. NCT01734096